UNITED STATES PATENT APPLICATION 

OF 

Joo Won KIM 

FOR 

APPARATUS AND METHOD FOR PERFORMING PIP IN DISPLAY DEVICE 
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[0001] This application claims the benefit of Korean Application No. P2003-023014, 
filed on April 11, 2003, which is hereby incorporated by reference as if fully set forth herein. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] The present invention relates to a display device, and more particularly, to an 
apparatus and method for performing a picture-in-picture (PIP) in a display device. Although the 
present invention is suitable for a wide scope of applications, it is particularly suitable for a sub- 
picture (or PIP) having a shape and size adjustable to a user's preference. 

Discussion of the Related Art 

[0003] As television broadcasting services have changed from the analog mode to the 
digital mode, the technologies in televisions have been greatly improved and developed both in 
quality and quantity. More specifically, the digital mode can operate a larger number of 
channels as compared to the analog mode, thereby providing an increased number of channels 
for television broadcasting. Also, the digital mode television provides the users with high 
resolution images of high definition (HD) quality. 

[0004] Recently, in order to meet with the demands of the users, household television 
receivers have become slimmer for space efficiency, and the television screen has become wider 
for an increased real-life vision. In addition, digital televisions are currently being developed so 
that a plurality of other input signals other than broadcast signals, such as personal computers, 



can be displayed simultaneously. For example, a picture-in-picture (PIP) function is applied and 
used. Generally, the picture-in-picture (PIP) function refers to a sub-picture being displayed 
over a main picture on the screen. Herein, the sub-picture may either be a reduced version of the 
main picture displayed in a smaller frame or a completely different picture from another channel 
displayed in a smaller frame. 

[0005] However, in the related art display device, only a sub-picture (or PIP) having a 
predetermined shape and size is provided, and the position of the sub-picture (or PIP) cannot be 
changed or moved. 

SUMMARY OF THE INVENTION 

[0006] Accordingly, the present invention is directed to an apparatus and method for 
performing PIP in a display device that substantially obviates one or more problems due to 
limitations and disadvantages of the related art. 

[0007] An object of the present invention is to provide an apparatus and method for 
performing PIP in a display device that displays PIP having a shape and size adjustable to a 
user's preference. 

[0008] Additional advantages, objects, and features of the invention will be set forth in 
part in the description which follows and in part will become apparent to those having ordinary 
skill in the art upon examination of the following or may be learned from practice of the 
invention. The objectives and other advantages of the invention may be realized and attained by 
the structure particularly pointed out in the written description and claims hereof as well as the 
appended drawings. 

[0009] To achieve these objects and other advantages and in accordance with the 
purpose of the invention, as embodied and broadly described herein, an apparatus for performing 



PIP in a display device includes a first video processor converting a first video signal into data 
representing a displayable main picture, a second video processor converting a second video 
signal into data representing a displayable sub-picture, and a microcomputer controlling the first 
video processor and the second video processor, so that at least one of the main picture data and 
the sub-picture data is partially outputted in accordance with a shape of the sub-picture. 

[0010] The microcomputer provides a user with a sub-picture setting menu for selecting 
and modifying the sub-picture shape. And, the sub-picture setting menu includes a plurality of 
selectable sample shapes, and a selectable option for creating and adding new sub-picture sample 
shapes based on the user's preference. 

[0011] The microcomputer either controls the first video processor, so as to output a 
portion of the main picture data corresponding to an area of the screen excluding the sub-picture 
shape selected or modified by the user, or controls the second video processor, so as to output a 
portion of the sub-picture data corresponding to the sub-picture shape selected or modified by the 
user. 

[0012] The microcomputer displays the sub-picture on a screen depending upon a pixel 
information corresponding to the sub-picture shape selected or modified by the user. 

[0013] In another aspect of the present invention, a method for performing PIP in a 
display device includes selecting or modifying a sub-picture shape by a user, converting a first 
video signal and a second video signal into data representing a main picture and data 
representing a sub-picture, respectively; outputting at least one of the main picture data and the 
sub-picture data partially outputted depending upon the sub-picture shape selected or modified 
by the user, and combining the outputted main picture data and sub-picture data. 

[0014] The user selects or modifies the sub-picture shape by using a sub-picture setting 
menu being displayed on a screen. The user either selects any one a plurality of sub-picture 



sample shapes included in the sub-picture setting menu, or modifies a pixel information of the 
sub-picture from the sub-picture setting menu, so as to modify a shape of the sub-picture. 

[0015] The step of outputting the main picture data and the sub-picture data comprises 
one of selectively outputting a portion of the main picture data corresponding to an area of the 
screen excluding the selected or modified sub-picture shape, and selectively outputting a portion 
of the sub-picture data corresponding to the selected or modified sub-picture shape. 

[0016] It is to be understood that both the foregoing general description and the 
following detailed description of the present invention are exemplary and explanatory and are 
intended to provide further explanation of the invention as claimed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0017] The accompanying drawings, which are included to provide a further 
understanding of the invention and are incorporated in and constitute a part of this application, 
illustrate embodiment(s) of the invention and together with the description serve to explain the 
principle of the invention. In the drawings; 

[0018] FIG. 1 illustrates a block diagram of an apparatus for performing PIP in a display 
device according to the present invention; 

[0019] FIG. 2 illustrates a block diagram showing a detailed structure of the display 
device according to the present invention; 

[0020] FIG. 3 illustrates a flow chart of a method for performing PIP in the display 
device according to the present invention; 

[0021] FIG. 4 illustrates a sub-picture setting menu according to an embodiment of the 
present invention; 
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[0022] FIG. 5 illustrates a sub-picture according to a first embodiment of the present 
invention; and 

[0023] FIG. 6 illustrates the sub-picture according to a second embodiment of the 
present invention. 

DETAILED DESCRIPTION OF THE INVENTION 
[0024] Reference will now be made in detail to the preferred embodiments of the present 
invention, examples of which are illustrated in the accompanying drawings. Wherever possible, 
the same reference numbers will be used throughout the drawings to refer to the same or like 
parts. 

[0025] FIG. 1 illustrates a block diagram of an apparatus for performing a sub-picture 
(PIP) in a display device according to the present invention. 

[0026] Referring to FIG. 1, among a plurality of broadcast signals, a tuner 10 selectively 
receives a broadcast signal selected by a user through an antenna. Then, a TP parser 20 divides 
the broadcast signal received from the tuner into a video signal and an audio signal. The divided 
audio signal and video signal are then inputted to a video decoder 60 and an audio decoder 30, 
respectively. The audio decoder 30 decodes the audio signal outputted from the TP parser 20 
and transmits the decoded audio signal to a digital/analog (D/A) converter 40. Then, the D/A 
converter 40 converts the decoded audio signal so that the converted decoded audio signal is 
outputted from a speaker 50 as a sound. 

[0027] The video decoder 60 decodes the video signal outputted from the TP parser 20 
and supplies the decoded video signal to a video processor 300. Herein, the decoded video 
signal includes a first video signal for displaying a main picture, and a second video signal for 
displaying a sub-picture. In order to display a main picture and a sub-picture on a display 90 



depending upon a user command inputted through an interface, the video processor 300 converts 
the first video signal into a displayable main picture data and converts the second video signal 
into a displayable sub-picture data. The video processor 300 then combines the main picture 
data and the sub-picture data. In addition, the video processor 300 can modify the shape and size 
of the sub-picture overlapping the main picture in accordance with the user command. Moreover, 
the video processor 300 converts video signals inputted from an external input unit 140 into 
displayable signals. 

[0028] A chroma processor 80 processes the video signal including one of a message 
and an icon outputted from the video processor 300, so that a message or an icon can be 
displayed on the display 90. 

[0029] A microcomputer 200 receives a user command inputted from the user interface 
100. The microcomputer 200 then controls the video processor 300, so that the shape and size of 
the sub-picture can be modified in accordance with the user command. In addition, the 
microcomputer 200 outputs corresponding control signals depending upon image settings and 
related history and information stored in a ROM 120 and a RAM 130. 

[0030] FIG. 2 illustrates a block diagram showing a detailed structure of the display 
device according to the present invention. 

[0031] Referring to FIG. 2, a first video input unit 71a receives the first video signal 
from the video decoder 60, and a second video input unit 71b receives the second video signal 
from the video decoder 60. The first and second video signals inputted to the first and second 
video input units 71a and 71b are divisionally stored in a memory 310. More specifically, for 
example, the first video signal is stored in a main picture memory 310a, and the second video 
signal is stored in a sub-picture memory 3 10b. 



7 



[0032] A first video processor 311 reads the first video signal stored in the memory 310 
and then converts the first video signal into a displayable main picture data. The main picture 
data converted at the first video processor 3 1 1 is then inputted to a picture quality enhancer 74 in 
order to enhance the picture quality of the converted main picture data. Additionally, a second 
video processor 312 converts the second video signal, stored in the memory 310, into a 
displayable sub-picture data. The first and second video processors 311 and 312 not only 
receives the first and second video signals stored in the memory 310, but can also directly 
receive the first and second video signals from the first and second video input units 71a and 71b. 

[0033] A PIP Multiplexer 75 receives the main picture data from the picture quality 
enhancer 74 and receives the sub-picture data from the second video processor 312. The PIP 
MUX 75 then combines the main picture data and the sub-picture data in order to display the 
sub-picture on the main picture. 

[0034] A color space converter (CSC) 76 converts the combined data from the PIP MUX 
75 into either Y, Pb, and Pr signals or R, G, and B signals. A look-up table (LUT) 77 controls 
and converts the Y, Pb, and Pr signals or R, G, and B signals based on a pre-determined screen 
information. The LUT 77 then supplies the outputted Y, Pb, and Pr signals or R, G, and B 
signals to the chroma processor 80 through a graphic on screen display (OSD) 78 and a D/A 
converter 79. 

[0035] The method for processing a sub-picture by using the device for processing a 
sub-picture in the display device according to the present invention will now be described in 
detail. 

[0036] FIG. 3 illustrates a flow chart of a method for processing the sub-picture in the 
display device according to the present invention. 
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[0037] Referring to FIG. 3, the microcomputer 200 determines whether the user desires a 
sub-picture to be displayed on a predetermined area of the main picture. In other words, the 
microcomputer 200 determines whether the user selects a sub-picture mode (SI 1). 

[0038] Depending upon the result of . step 11, when the microcomputer 200 determines 
that the user has selected the sub-picture mode, then the microcomputer 200 displays a "Sub- 
picture setting menu" on the display 90 (SI 2), as shown in FIG. 4. The Sub-picture setting menu 
includes a plurality of sub-picture sample shapes, which the user can select according to his or 
her liking. The menu also includes a "User Setting" selectable option allowing the user to 
modify the shape of the sub-picture. For example, the sub-picture samples include the shapes of 
a circle, a heart, a triangle, a square or rectangle, and so on. The user can select any one of the 
shapes by using a remote controller. In addition, when the user selects the User Setting option, a 
window allowing the user to modify and create a desired sub-picture shape is supplied. If the 
user desires a diamond (or lozenge) shape sub-picture, the user selects the fourth sub-picture 
sample shape (i.e., a square or rectangle) and uses the remote controller to replace the positions 
of each angular point, so as to modify the square or rectangle into a diamond (or lozenge) shape. 
Herein, each of the angular points of the square or rectangle can be replaced by modifying the 
corresponding pixel information (i.e., the pixel address). 

[0039] The above-described diamond shaped sub-picture created according to the user's 
settings can be added as a sub-picture sample shape. When the user desires to add the newly 
formed sub-picture sample shape in the Sub-picture setting menu, the microcomputer 200 
upgrades the Sub-picture setting menu and stores the upgraded menu in either the RAM 130 or 
the memory 310. 

[0040] The Sub-picture setting menu includes buttons for controlling the size of the sub- 
picture. For example, when the user selects the "Size" selectable option in the Sub-picture 



setting menu, as shown in FIG. 4, an "Enlarge" button and a "Reduce" button are displayed on 
the screen. When the user selects the Enlarge button by using the remote controller, the size of 
the sub-picture is increased. Conversely, when the user selects the Reduce button, the size of the 
sub-picture is decreased. 

[0041] The Sub-picture setting menu also includes a plurality of buttons for controlling 
the position of the sub-picture. For example, when the user selects the "Position" selectable 
option in the Sub-picture setting menu, as shown in FIG. 4, an "Up" button, a "Down" button, a 
"Left" button, and a "Right" button are displayed. When the user selects either the Up button or 
the Down button, the position of the sub-picture in the display 90 moves either up or down, 
respectively. On the other hand, when the user selects either the Left button or the Right button, 
the displayed sub-picture moves to either the left side or the right side in the display 90. 

[0042] Furthermore, the Sub-picture setting menu includes a button allowing the user to 
select the number of sub-pictures to be displayed on the display 90. When the user selects the 
"Miscellaneous" selectable option on the Sub-picture setting menu, as shown in FIG. 4, a 
plurality of buttons for selecting and/or controlling the number of displayed sub-pictures, the 
emphasis of the sub-picture in contrast with the main picture, and so on, are displayed. 

[0043] When the user selects the shape and the size of the sub-picture (SI 3), the 
microcomputer 200 identifies the display mode in the sub-picture area (SI 4). The display mode 
is previously determined by the user. Two types of sub-picture display modes are supplied in the 
present invention. The display modes include manipulating (or modifying) the main picture data 
according to the sub-picture shape selected by the user, and manipulating (or modifying) the sub- 
picture data according to the sub-picture shape selected by the user. 

[0044] As shown in FIG. 5A, when selecting the mode of manipulating the main picture 
data, the first video processor 311 transmits the main picture data corresponding to the remaining 
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area of the screen, excluding the circle-shaped sub-picture 302 selected by the user, to the PIP 
MUX 75, and the second video processor 312 transmits the entire sub-picture data to the PIP 
MUX 75 (SI 5). At this point, the microcomputer 200 controls the first video processor 31 1 by 
using the pixel information of the selected sub-picture, so as to selectively supply the main 
picture data to the PIP MUX 75. 

[0045] The sub-picture data supplied to the PIP MUX 75 is a data corresponding to a 
square-shaped sub-picture, however, a circle- shaped sub-picture 302 is displayed on the display 
90. The peripheral area (A) of the circle-shaped sub-picture 302 is an area where the sub-picture 
overlaps the main picture. However, the emphasis of the sub-picture in contrast with the main 
picture may be controlled, so as to display only the main picture in the area (A). 

[0046] As shown in FIG. 5B, when selecting the mode of manipulating the sub-picture 
data, the first video processor 311 supplies the entire main picture data to the PIP MUX 75, and 
the second video processor 312 supplies only the sub-picture data, corresponding to the circle- 
shaped sub-picture 302 selected by the user, to the PIP MUX 75 (SI 9). At this point, the 
microcomputer 200 controls the second video processor 312 by using the pixel information of 
the selected sub-picture, so as to selectively supply sub-picture data to the PIP MUX 75. 
Accordingly, the circle- shaped sub-picture 302 is displayed on the display 90. 

[0047] Other examples may also be applied in the present invention, apart from the two 
types described above. For example, when the sub-picture data corresponding to circle-shaped 
sub-picture 302, selected by the user, and the main picture data corresponding to the remaining 
picture area excluding the circle-shaped sub-picture 302 is supplied to the PIP MUX 75, the 
circle-shaped sub-picture 302 is displayed on the display 90. The microcomputer 200 controls 
the first and second video processors 311 and 312 by using the pixel information of the selected 
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sub-picture, so as to selectively supply the main picture data and the sub-picture data to the PIP 

MUX 75. 

[0048] Another example will be described with reference to FIG. 6. When an OSD 
screen is displayed (S20), the OSD data corresponding to the remaining area of the screen 
excluding the circle-shaped sub-picture 302 area and the sub-picture data corresponding to the 
circle-shaped sub-picture 302 is supplied to the PIP MUX 75, thereby displaying the circle- 
shaped sub-picture 302 on the OSD screen (S21 to S23). 

[0049] The PIP MUX 75 receives the main picture data and the sub-picture data from the 
first video processor 311 and the second video processor 312, respectively, combines the main 
picture data and the sub-picture data, and, then, outputs the combined data. At this point, the PIP 
MUX 75 controls the emphasis of the sub-picture in contrast with the main picture in accordance 
with the control of the microcomputer 200. 

[0050] Accordingly, the apparatus and method for performing PIP in the display device 
according to the present invention provides a sub-picture setting menu for modifying the sub- 
picture (e.g., PIP), so as to adjust not only the shape but also the size and position of the sub- 
picture. Therefore, the user can select and modify the sub-picture according to his or her 
preference. 

[0051] It will be apparent to those skilled in the art that various modifications and 
variations can be made in the present invention without departing from the spirit or scope of the 
inventions. Thus, it is intended that the present invention covers the modifications and variations 
of this invention provided they come within the scope of the appended claims and their 
equivalents. 
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